Emergency response augmented reality-based notification

ABSTRACT

Embodiments of the invention leverage mobile proliferation to enable laypersons to initiate a timely and effective emergency response in case of an emergency, such as a medical emergency, e.g. cardiac event. Mobile apps are made available as part of an organization&#39;s overall response plan and program, allowing bystanders of emergency events to easily initiate notifications, for example to trained responders, for example in their facility, in a timely manner commensurate with the type of emergency specific to their facility. More particularly, embodiments of the invention use mobile applications to provide augmented reality-based alerts and notifications, for example to certified first trainees to respond to the scene of the emergency.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of U.S. patent applicationSer. No. 15/085,492, filed Mar. 30, 2016, which is a continuation ofU.S. patent application Ser. No. 14/269,030, filed May 2, 2014, now U.S.Pat. No. 9,324,120, which claims priority to U.S. provisional patentapplication Ser. No. 61/832,691, filed Jun. 7, 2013, and to U.S.provisional patent application Ser. No. 61/892,836, filed Oct. 18, 2013,each of which application is incorporated herein in its entirety by thisreference thereto.

TECHNICAL FIELD

The invention relates to responding to emergencies. More particularly,the invention relates to providing augmented reality-based (AR-based)alerts to proximate, workforce or other personnel in the event of anemergency, such as a medical or other emergency.

BACKGROUND

Emergency response is a serious problem. Under such systems as 911, whenseconds count, a responder is at least several minutes away. Consider,for example, cardiac arrest. Each Year 330,000 Americans experiencesudden cardiac death, yet less than 5% of Americans receive CPR trainingannually. The majority of these trainees are health care professionalswho work in controlled medical environments such as hospitals,ambulances, and clinics. However, the majority of cardiac arrests takeplace at work or in the home. While EMS systems have evolved to bringtrained medical professionals to the scene of a medical emergency morerapidly, the optimal window for medical intervention in a cardiac arrestis often too narrow to allow for the timely transport of equipment andskills to the location of the victim.

The probability of surviving an out-of-hospital cardiac arrest is atleast doubled for victims who receive bystander CPR. In addition,cardiac arrest victims who receive bystander CPR and the benefit of anautomated external defibrillator (AED) that can deliver a shock to theheart within four minutes quadruple their survival with reports ofsurvival between 34-70%.

However, victims receive the benefit of bystander CPR only 7-28% of thetime and receive the combined benefit of bystander CPR and AEDapplication only 2-3.4% of the time. While researchers and cliniciansunderstand what elements are necessary to improve survival from cardiacarrest, it is as yet not possible to deliver these components to thecardiac arrest victim in a timely fashion.

A major problem in this regard lies in the fact that there isstatistically a very small likelihood that a trained responder ispresent when a cardiac arrest occurs. The bystander, unfamiliar with theemergency medical response, most often does nothing, or merely callsemergency medical services (EMS), i.e. 911.

A sudden cardiac arrest (SCA) is an emotionally daunting event. As such,most laypersons are unwilling to perform unfamiliar tasks, such as AEDand CPR, in public under these emotionally charged circumstances. Thebest EMS response times nationwide are greater than four minutes, andthe average response time is between 8-12 minutes. Thus, trainedpersonnel, and the appropriate equipment (AEDs), arrive at the victim'sside too late to impact survival. This is best understood when oneconsiders that EMS requires a minimum of an additional 2-4 minutes toprocess a call. EMS obtains information regarding responders andequipment voluntarily and is therefore an incomplete network of bothtrained responders and equipment. EMS has no way to ascertain thecontinued validity of the information initially provided, whichexperientially has been demonstrated to change by 20%/year. Further, EMShas no way to ascertain the operational status of the equipment becauseit does not maintain this information itself.

Additionally, EMS has no way to customize the information based onorganizational structure, nor does it have the operational plans andprotocols of different organizations in the community.

To address this issue, many workplaces have instituted internalemergency response plans and trained workplace personnel in CPR and AED.They have purchased AEDs to be placed at convenient locations throughoutthe workplace. However, the average number of trained personnel in theworkforce averages 2-10% Therefore, victims still do not collapse neartheir trained responders.

The foregoing discussion considers a single type of emergency, i.e. aspecific medical emergency. Yet, there are many types of emergenciesthat require prompt and, often, a skilled response. It would beadvantageous to provide an approach that enables prompt notification toelicit early response to such emergencies.

SUMMARY

Embodiments of the invention leverage mobile proliferation to enablelaypersons to initiate a timely and effective emergency response in caseof an emergency, such as a medical emergency, e.g. cardiac event. Mobileapplications (APPS) are made available as part of an organization'soverall response plan and program, allowing bystanders of emergencyevents to easily initiate notification of, for example, trainedresponders, specific to their facility. More particularly, embodimentsof the invention use mobile applications to provide AR-based alerts toworkforce personnel, such as to certified first responders, to respondto the scene of the emergency. In the example of first responders,mobile applications also inform certified first responders of thenearest operational emergency equipment and can provide specificinstructions to the certified first responders regarding the emergencyand how best to respond.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an organization diagram showing the participants in a tieredresponse system according to the invention;

FIG. 2 is a flow diagram a medical emergency response model according tothe invention;

FIG. 3 is a block schematic diagram showing the main components of anemergency response notification system according to the invention;

FIG. 4 is a flow diagram that shows a sequence ofactivities/communications in a medical emergency (ME) according to theinvention;

FIG. 5 is a flow diagram showing the sequence of operations during anemergency event according to the invention;

FIG. 6 is a flow diagram showing the sequence of operations during anSCA emergency event according to the invention;

FIG. 7 is a flow diagram showing a non-medical emergency response modelaccording to the invention;

FIGS. 8A-8C are a flow diagrams showing the sequence of operationsduring a non-medical emergency event according to the invention;

FIGS. 9A-9D are a series of screenshots showing a workforce evacuationnotification sequence according to the invention;

FIG. 10 is a flow diagram showing an example of how the role-baseddetails are lifted out of the emergency response protocol andtransmitted to the appropriate role-based individual in an emergency,where an electronic site survey generates organization specificemergency response protocols that detail role-based tasks according tothe invention;

FIG. 11 is a flow diagram showing the cancellation of an alert accordingto the invention;

FIGS. 12-17 are screen shots showing various user screens provided bythe APP during an emergency;

FIG. 18 is a flow diagram showing the creation of a digitalrepresentational map of a facility according to the invention;

FIG. 19 is a flow diagram showing the installation or integration of thesystem with physical sensors according to the invention;

FIG. 20 is a flow diagram showing the establishment of horizontal andvertical planes according to the invention;

FIG. 21 is a flow diagram showing the placement of digital markersaccording to the invention;

FIG. 22 is a flow diagram showing the defining of routes according tothe invention;

FIG. 23A is a flow diagram showing the indoor localization of a personor object according to the invention;

FIG. 23B is a flow diagram showing the outdoor localization of a personor object according to the invention;

FIG. 24 is a flow diagram showing routing according to the invention;

FIGS. 25 and 26 show the placing of markers in connection with AR-basedrouting within or about a facility; and

FIG. 27 is a block schematic diagram showing a machine in the exampleform of a computer system within which a set of instructions for causingthe machine to perform one or more of the methodologies discussed hereinmay be executed.

DETAILED DESCRIPTION

Embodiments of the invention facilitate notification to workforcepersonnel in the event of an emergency, for example to prompt thearrival of trained personnel with the appropriate equipment to aid in anemergency, for example to assist a cardiac arrest victim or otheremergency. In embodiments, individuals having no training can now alerttrained co-workers in their workplace to respond immediately in anemergency, e.g. to the victim of cardiac arrest, via a mobileapplication that notifies all trained responders in the facility viatext and email. This allows the untrained bystander to contribute in ameaningful way in an emergency while not requiring the bystander toperform an unfamiliar task in public under pressure. Importantly, while911 can be included as part of the initial notification, the use of the911 service is not required to obtain or send the initial notifications,thus saving important minutes.

Embodiments of the invention include a database that tracks the trainingand certification of all workplace personnel, as well as the date oftheir certification, and whether they have received special responderclasses or other applicable training classes or certifications. Trainedpersonnel are notified by the bystander in order, prioritized, forexample, by the quality of their training and preparation, as defined bythe most recent certification dates, and whether they have received aspecial responder class or other applicable training classes orcertifications.

Those skilled in the art will appreciate that, while the invention isdescribed in connection with trained responders and medical emergencies,embodiments of the invention apply generally to notifying andcommunicating with any set or subset of workforce personnel for any typeof emergency. For example, application of the invention to workforceassembly and mustering are described in greater detail below.

In the case of a cardiac arrest response, the trainees are tracked bythe completion of CPR, AED, and AED Responder online training modules,and their dates of completion. They are also tracked by the date theydemonstrate skills competence in these classes, as verified by aninstructor. Certification is awarded when both the online trainingmodules and skills competence have been successfully completed.Re-certification is required every two years and each re-certificationdate is maintained in the system. Trainees are also tracked by thecompletion of the AED responder class, and they are awardedcertification upon completion of this class.

The rules engine first looks to the closest facility, then prioritizesby the trainees who have current certification in AED Responder andCPR/AED. Next, it looks to trainees who have current certification inCPR/AED, but not AED Responder. Next, it looks to trainees who havepreviously been certified, but are not currently certified in CPR/AED.Then, it looks to trainees who have previously completed either CPR/AEDskills or the online training programs. Those skilled in the art willappreciate that the order of prioritization may be changed and that somesteps may be left out, while other steps may be added, all asappropriate and desired. Further, while this embodiment of the inventionconcerns medical emergencies and, in particular an SCA, those skilled inthe art will appreciate that such rules and prioritization can beapplied as appropriate to any emergency event in which the invention isused.

FIG. 1 is an organization diagram showing the participants in a tieredresponse system according to the invention. In embodiments of theinvention, a four-tier emergency response system is established fororganizations. Each tier of the emergency response system has its ownroles and responsibilities. Training specific to each tier'sresponsibilities is provided, as are the equipment and tools necessaryfor each tier to fulfill their respective roles.

Organization-wide emergency policies and procedures are developed withthe leaders of the organization 11, the first tier. The second tier ofthe system, each facility's program coordinator 12, develops a facilityspecific emergency response plan. The trained responders 13 form thethird tier of the emergency response system, and the fourth tier is thegeneral workforce 14 who is not trained and is targeted by a mobileapplication. An emergency/disaster physician 10 typically oversees theemergency response system in the case of medical emergencies.

Those skilled in the art will appreciate that the invention is notlimited to medical emergencies and applies as well to other emergencies,such as might occur in the case of a fire, flood, storm, earthquake,terror attack, etc. A key feature of the invention is thebystander-initiated notification of an emergency for which a response bytrained personnel is required and the automatic identification andnotification of such responders on the basis of event-related rules, aswell as prioritization of such notifications. This creates and ad hocnetwork for emergency response that is independent of public services,such as the 911 service. As such, there is no need to operate through anintermediary, such as a central dispatcher. In this way, precious timeis saved. This is especially important in a cardiac arrest because thelikelihood of survival decreases by 10% with each passing minute fromthe moment of collapse. It is estimated that on average, use of aninternal notification system decreases the time to defibrillation from10-12 minutes to 1-3 minutes. If the emergency is a wide-ranging event,where a central response system would be overburdened and, as such,subject to limited resources and degraded response times. Embodiments ofthe invention avoid such bottleneck. Nonetheless, embodiments of theinvention are able to create an impromptu, tiered command structurethrough the application of rules and prioritization with regard to thecommunication of notifications. These rules define roles and assessabilities, locate equipment, and the like without the need for a centraldispatch facility.

For example, with regard to non-medical emergencies, each company shouldhave an emergency response plan. Such plans include the concept of whodoes what, in what instances, and when.

For example, at Tier one, incident command, one to three people aredesignated as the incident command, where two of the people are backups.The organization's Emergency Response Plan includes a list of initialtasks that should be immediately completed in case of specificemergencies, for example in a fire. The incident commander's initialresponsibilities include for example, turning off elevators, escalators,shutting down secure areas, calling the Fire Marshall, calling thesecurity team, etc.

Practically speaking, in a private sector emergency, incident commanderstypically, have very little experience with managing emergencies and donot know what their initial tasks are. They somehow need to find theirlong neglected, dusty emergency response plan notebook, written bysomeone else, at some previous time, in a drawer somewhere.

In contrast thereto, with the herein disclosed alert APP, a bystandercan click on, e.g. fire and the incident commander receives a text thatlists all the initial tasks that he is charged with, and a link to hisprotocol or plan.

Tier 2 and, sometimes Tier 3, includes the emergency response team orfloor wardens, which consists of a predetermined number of people perfloor; and/or security, which is variable by company, i.e. differentnames are often used in the middle tier for similar function. At thislevel in the hierarchy, participants receive texts and/or emails thattell them exactly what equipment they should retrieve, where it islocated, and directions to where they should station themselves toassist in the evacuation. Such notifications list the proper steps inevacuating personnel, e.g. links to additional immediately necessaryinformation. Their responsibilities, tasks, and the equipment they needto retrieve information are described in their organization's emergencyresponse policies and procedures, again in a notebook an unknown dustydrawer, and which no one reads, but for which they are responsible. Inembodiments of the invention, the APP extracts the relevant task relatedinformation from the emergency response plan, which is pre-loaded intothe database, and which is accessible by defined fields, and transmitsthis critical information to specific individuals who need it at thetime they need it.

In appropriate emergencies, the general workforce receives instructionsto evacuate, and directions to the nearest evacuation exist, as well asthe location and directions to the assembly point located at a safedistance from their building or facility.

The individuals are pre-configured in the database as to their role,i.e. incident commander, emergency response team, security, generalworkforce, etc. The individuals receive instructions from theirpre-existing emergency response plans (ERPs), and policies, procedures,and protocols according to their role. These instructions are takendirectly from the company's emergency response policies, procedures,protocols and plans, all of which are documents that are stored in thedatabase by templates and fields of unique texts, and which can belifted into the notification text. This information comes directly fromthe database, is collected initially by management applications, and isselected for the particular user using the rules engine.

An important aspect of the invention concerns that fact that eachparticipant in the emergency response system is enabled to communicatewith each other person, and such communications are organized in tiersto implement a command structure spontaneously and in real time. Thus,roles are filled from a pool of candidates based upon their availabilityand also, for example, their proximity, skills, certification, etc.Information within the network of participants is routed, based upon therules and prioritization, to the right person when it is needed. Thus,in addition to defining a tiered organizational structure in real time,the system provides instructions as well. In this way, each individual'srole is reinforced, and each individual's skills are augmented. Forexample, the location of each participant in the emergency responsesystem is known from the individual's profile information and/or fromreal time tracking information; each individual's skills andavailability is known; and all emergency equipment in inventory is knownas to its location, capabilities, and operational state.

In embodiments of the invention, a database and rules engine provide aninformation storage and routing facility, although in other embodimentsof the invention such structure and knowledge need not be stored in acentral server or cleared through a central dispatch facility. Rather,the initiation of an alert by a bystander propagates a series ofnotifications through a network of participants, for example, by use ofan APP on their personal wireless device, where all rules andinformation is distributed, with pertinent rules for each individual ontheir device, as well as all profile information that is necessary toinvolve the individual appropriately in the tiered emergency responsestructure. In all embodiments of the invention, the mobile device cancomprise, for example, a smartphone, such as an iPhone, tablet, watch,automotive device, aviation or nautical device, wearable device, such asGoogle Glass, or any other device that is capable of receivingtransmissions.

Thus, in embodiments of the invention, the APP is used independently ofa server, such as the rules engine and database. In such cases, the APPis subject to periodic synching with the database to ensure that thecached information stored in the APP remains current. Further, thedatabase and rule engine can be periodically distributed to or cached onone or more of the handheld devices as a backup if the central system isnot reachable during an emergency. Notifications are then sent directly,to the extent possible, from the bystander's phone.

In some embodiments of the invention, a more comprehensive user profileis collected at time of registration, and the user can inform the systemof any skills, professional license, training, or equipment that theyhave and are willing to share, i.e. there may be people who were nottrained by a specific organization; who are not known to be trained butare, in fact, trained; and/or have capabilities that would enable themto assist in an emergency.

In other embodiments of the invention, the APP is downloaded byworkforce members, or even ordinary people who may or may not be part ofan organization and who, as part of their user profile, potentially wishto share their medical information, i.e. potential patients and/orvictims, so that they can personally initiate an alert, and indicateconsent by a separate button “Share my medical information” with thetrained responders to facilitate care. For example, a workforce membermay be diabetic, and initiate the internal response system by selecting“share my information,” in which case the responders would be notifiedthat he is a diabetic and they could bring orange juice or sugar for amore rapid recovery. Other examples of the aspect of the inventioninclude individuals who are allergic to certain foods, e.g. peanuts, ormedications and who, upon feeling symptoms of an allergic reaction,could initiate a call for assistance that can also indicate, forexample, the fact that the individual carries an EpiPen, which theresponder could then find in the individual's purse, etc. Once found,this would allow the individual to be injected. Another example concernssomeone who has a pacemaker or an internal defibrillator that they cantell is malfunctioning. In such case, they can send out a notificationand receive immediate assistance. In the foregoing embodiments, rulesare applied to identify an individual having known disabilities, asspecified during the individual's registration, and a pre-configureddistress signal is issued during, for example, an evacuation, withspecific instructions for the trained responder, and directions to thenearest appropriate equipment based upon the disability, to assist theindividual with equipment necessary to ensure that they are able toevacuate the individual.

In an embodiment of the invention, the general workforce is provided anoverview of the organization's emergency response program. The overviewprovides the workforce with the knowledge that the organization hasemergency response resources in its facilities, that there are trainedresponders, that there is an internal emergency response system, andthat they play an important role in the system, i.e. to activate thesystem to bring trained responders to the scene of the emergency.

The emergency response program can pertain to a building, a campus, atown, or any other facility or organization. The program can include,for example, predetermined assembly areas at which individuals are togather in the event of an emergency. Embodiments of the invention allowindividuals to be tracked and located, or to send out distress messages.In this way, those individuals who did not successfully escape can beassisted.

For example, upon notification of the need to evacuate and instructionsand/or directions on where their closest evacuation point and assemblyarea is located, a member of the general workforce, is provided withthree successive buttons that appear on their APP:

First, a button is provided that instructs the member: “Press to confirmthat you have received the evacuation notification;”

Next, a button is provided that instructs the member: “Press to confirmthat you have evacuated out of the building;” and

Next, a button is provided that instructs the member: “Press to confirmthat you have reached the assembly area.”

A button stays on the screen that instructs the member: “Press toindicate that you are having difficulties evacuating,” and a text fieldis provided to allow the participant to tell Incident Command (IC) whatproblems they are having and where they are located.

A report is constantly updated based on individuals confirming theirevacuation, or lack thereof. The report is available to the IC anddistributable by regions to the responsible ERT or security teams.Ideally, in companies that have security upon entering the building, theinitial list of individuals inside in the structure is updated withthose that have successfully evacuated, and special alerts are sent toICs and ERT/security for individuals who are having difficultyevacuating and need assistance.

The mobile application (“APP”) 16 empowers lay bystanders to play acritical yet simple role in the organization's emergency response systemand provides them the tool with which to participate. The mobileapplication allows the bystander to initiate the facility's emergencyresponse plan more rapidly by yelling out for help in the mannerdescribed in the emergency response plan, such as yelling out for helpor using the nearest squawk box. Next, the APP instructs the laybystander to notify trained workplace personnel via the mobile APP.Next, the APP instructs the lay bystander to initiate a call to 911, orthe APP directly calls 911 by presenting the user with a button thatindicates “Press to call 911.” Once the button is pressed, the APP opensthe phone function and places the call. The mobile APP continues tofollow the originally prescribed emergency response plan but facilitatesthe more rapid arrival of trained responders. The mobile APP alsoprovides a mechanism with which to simulate, for example, an SCA, withits drill function.

Medical Emergencies—Emergency Response Notification System

FIG. 2 is a flow diagram a medical emergency response model according tothe invention, in which the relationship between the general workforce,emergency response team and emergency medical services is shown. Theflow in this model is discussed in detail below.

FIG. 3 is a block schematic diagram showing the main components of anemergency response notification system according to the invention. Thesecomponents include a database 20 that stores data acquired throughmanagement applications; a rules engine 22, including a learningmanagement system (“LMS”) that acquires and hierarchically stores rawdata and that analyzes the data based on rules; a multi-mode,multi-dimensional communications, and two-way messaging andcommunication system 24, including emails, an SMS gateway 25, telephoneand intelligent communications to provide progressive levels ofintelligence, analyzed information, and compiled information that isdynamically driven by the rules engine, and including a mechanism forsending and receiving both human-to-human and technology generatedintelligence, e.g. two-way communications and content between systemparticipants, such as an alert initiator 27 and an alert responder 23;Web services 26 which communicate via the Internet 21, includingbusiness logic that performs functions directly on the database,initiates communications, provides analysis, and compiles reports; amobile application 16 that provides an access point to the system and/oruser interface; and geo-location capabilities 29.

Data stored in the database includes, for example:

-   1. Name of all individuals who have downloaded the APP, including    their organization, their specific facility (location), their email    address; and a cell phone number.-   2. Name of all trained responders, including their organization,    their specific facility (location), their email address; a cell    phone number, and the date of their most recent certifications, e.g.    CPR/AED certification, AED responder certification, first aid    certification, and the date of their most recent training, if they    are not certified. Such information can also include the responder's    role within a tiered emergency response organization and the    specific emergency type for which they are to receive notification.-   3. Location of emergency equipment, such as AEDs by organization,    facility, address, location in facility, e.g. floor, and specific    description of location, such as 9th floor elevator South, and GPS    coordinates; date of last successful maintenance; and date of    expiration for critical equipment, components, supplies, and    medication that require routine replacement due to their age and/or    expiration date.-   4. Location of first aid, medical kits, oxygen, blood borne pathogen    (BBP) kits by organization, facility, address, location in facility,    e.g. floor, and specific description of location, such as 9th floor    elevator South, and GPS coordinates; date of last successful    maintenance; and date of expiration for supplies, equipment, and    critical equipment, components, supplies, and medication that    require routine replacement due to their age and/or expiration date.-   5. Location of event initiated by APP by address, specific    descriptive location, and, GPS.-   6. Name(s) of designated Incident Control Commander(s) (IC),    including their organization; their specific facility, address, GPS    (location); email address; cell phone; and competence level, e.g.    they can they make secondary decisions to initiate variable    protocols and/or rely on preconfigured content, based on experience,    training, using rules.-   7. Name of designated Team Leaders, Security (Modified    structures/designations) (TL), including their organization; their    specific facility, address GPS (location); email address; cell    phone; date of most recent CPR/AED certification; date of most    recent AED Responder certification; date of most recent First Aid    certification; date of most recent Evacuation Leadership training,    or other pre-configured training requirements; date of most recent    Incident Command (or other relevant) training; duration of service;    and previous experience.-   8. Name of all workforce personnel (WF), including their    organization; their specific facility, address, GPS (location);    email address; and cell phone.-   9. Location of other Medical Emergency Equipment First Aid, Medical    Kits, Oxygen, BBP kits, and other relevant supplies and/or    equipment, including by organization; by facility; by address; by    location in facility, e.g. floor, and specific description of    location, such as 9th floor elevator South; by GPS coordinates; date    of last successful maintenance; and date of pad and battery,    medication expiration, AED's or other medical equipment or    perishable supplies.-   10. Location of non-emergency equipment and emergency equipment,    such as fire extinguishers, evacuation equipment for personnel with    disabilities, radios, walkie talkies, megaphones, vests, flags,    etc., including by organization; by facility; by address; by    location in facility, e.g. floor, and specific description of    location, such as 9th floor elevator South; by GPS coordinates; and    date of last successful maintenance.-   11. Geo-location of boundaries of facility.-   12. Geo-location of assembly area.-   13. Dynamically generated geo-mapping and/or other technology for    location of cell phones of workforce during emergency.-   14. Comparison of security data of personnel location vs. confirmed    evacuees and/or location of cell phones of workforce during    emergency.    Rules

Rules can be implemented based on a pre-configured designation or theycan be implemented dynamically.

Pre-configured rules are, for example, when an individual registers forthe APP in the Boston Facility, an emergency notification is initiatedin the Boston Facility and the database sends notifications to trainedresponders in the Boston facility, along with instructions about thelocation and operational status of AEDs in the Boston facility.

Dynamic rules are, for example, where the individual who is registeredin Boston initiates an alert while in Maryland, as determined by GPS andaddress location applications, and the rules engine modifies its searchdynamically for equipment and responders based on the individual'sactual location. In this case, location can be accomplished by acoordinate mapping of the facility interpreted into addresses using GPSand address location applications, where the rules engine modifies itssearch for equipment and responders based on the individual's actuallocation.

Further, such rules can include the individual's role within a tieredorganizational structure. In such case, the rules establish appropriaterouting and chain-of-command to establish an ad hoc emergency responseorganization in real time.

For example, if the primary Incident Commander does not respond to theinitial notification because, for example, he is out of town at aconference or sick, the rules engine notifies the first back-up incidentcommander and, if no response is received, then contacts the nextback-up incident commander. The individual who first confirms ICnotification receives a follow up text and/or email with an initial tasklist to perform and links to additional information that may be needed.

Organizations designate certain individuals as their ERT members orfloor wardens and provide training to them. It is not known which ofthese workers are available on the day and time they are needed. Therules engine continues to search for appropriate responders, prioritizedby training, experience, and location based on pre-configured data. Aseach potential responder confirms receipt, the responder is providedwith the next series of tasks that needs to be performed on a per flooror per facility basis. For example, if the assignment to assist in theevacuation of the general workforce, then the first responder to confirmis sent to the primary exit door on the floor to shuttle the workforceout the appropriate exit door; the next responder is sent to theappropriate evacuation door from the building to continue exiting theworkforce from the building; the third responder is located at theground level to shuttle the workforce out of the building; and a fourthresponder leads the evacuated workforce to the assembly area, etc.Security can be sent to assist distress calls that are routed throughincident command (IC).

Process Flow

FIG. 4 is a flow diagram that shows a sequence ofactivities/communications in a medical emergency (ME) according to theinvention. Those skilled in the art will appreciate that the inventionis readily applicable to other types of emergency.

As shown in FIG. 4, a bystander of an ME (100), in this case an SCA,initiates the emergency response notification system via a mobileapplication (102) by accessing and using the APP on a phone, tablet,etc. The bystander communicates with the APP and can enter the specificlocation of the ME within the facility, e.g. 3rd floor bathroom, by anyform of information entry, such as typing, voice, etc.

As discussed above, the APP exchanges information via a communicationsystem and Web service to access and interact with a rules engine anddatabase. Information that is input by the bystander, e.g. via acellular service, WIFI, and/or other system, is transmitted via the Webservice to the rules engine and database.

In embodiments of the invention, a secondary screen displays, forexample, a drop down or other menu that allows the bystander to select,for example the type of medical emergency, e.g. SCA. The selection ofpre-configured types of medical emergencies shown on the displayprovides the bystander with a text description of each medicalemergency, and thus facilitates an early assessment of the situation.

In embodiments of the invention, the bystander can also place a call toa service, such as 911, by calling 911 directly from the APP. Asdiscussed above, the APP exchanges information via a communicationsystem to access and, to the extent possible, interact with the 911service. Where supported by the 911 service, information that is inputby the bystander, e.g. via a cellular service, WIFI, and/or othersystem, is transmitted to the 911 service.

Responsive to the notification, the bystander of the ME receives anoptional instruction to initiate first aid or resuscitation or otherassistance as specified on the APP (104).

The APP receives a message that asks the bystander if there is anemergency (106). In this case there is an emergency, an SCA, as notedabove. If the bystander is seeking information, but not providingnotification of an emergency, the bystander can select the “No” buttonon the APP, in which case the bystander is provided with training links,(108) and can choose, as well, to receive further information inconnection with such training (110).

In the bystander selects the “Yes” button on the APP, indicating thatthere is an emergency, the bystander may be alerted to yell out than anME has occurred (109), e.g. “Medical emergency, we need an AEDresponder!” Embodiments of the invention contemplate using the systemfor preparedness training. Thus, the APP provides a drill options switch(111) for executing practice sessions. The scope of the drills can beestablished as desired (112), e.g. facility-wide or classroom drills.Drills can be coded to include only designated individuals, i.e. thosein a specific class; or they can be non-coded, in which case all of theresponders in the facility are notified of the drill.

In this example above, the ME is not a drill and the APP provides asimple dialog to the bystander to provide location information to thesystem such that trained responders can be located (114). Responsivethereto, the Web service runs a rule-driven query of rules engine anddatabase that compares the location of event to that of a nearestfacility having trained responders. The system locates nearest trainedresponders in the facility and prioritizes notification of the trainedresponders by applying rules that determine the level and type oftraining and competence required of the trained responder, as well asthe proximity of the trained responder to the event. The system alsolocates the nearest appropriate equipment for the ME, such as AEDs andother medical equipment in the case of an SCA. The location of suchequipment is prioritized by rules that evaluate the proximity of theequipment to the event, as well as the operational status of theequipment, e.g. if it has been recently serviced and is operable.

The bystander is also asked if the 911 service has been called (116). Ifthe bystander responds with “Yes,” then the bystander is asked if the911 service is being called by a person other than the bystander (118),e.g. if “Yes,” press the purple button. If the bystander responds with“No,” the 911 service has not been called then the bystander isinstructed to call the 911 service (120), e.g. press the green button tocall the 911 service and proceed to the next screen.

Responsive thereto, a message containing specific information is sent toselected trained responders. In such case, the rules engine and databasegenerate the message and the specific location of event within thefacility is communicated to the selected trained responders withinstructions to respond, prioritized by the trained responder'straining, competency, and proximity rules. Embodiments of the inventionalso send the cell phone number of the bystander to the trainedresponder.

One or more messages are sent to the bystander indicating how manytrained responders have been notified, e.g. to provide the bystanderwith peace of mind. In this case, the rules engine and database generatethe message and the communications system sends the message to thebystander.

If no responders are available, a message sent to the bystanderidentifying the location of the nearest appropriate equipment, e.g.AEDs, prioritized by functionality rules. In this case, the rules engineand database generate the message and the communications system sendsthe message to the bystander.

The trained responders respond to the alert text with a confirmationmessage that communicates to the database via Web service indicatingthat they are responding. The message generates the geo-location of thetrained responder.

One or more additional messages are sent to the bystander. Thus, as eachtrained responder responds to the alert, indicating whether the trainedresponder is coming or not coming to assist, the bystander receives suchmessages, e.g. for the bystander's peace of mind and to indicate thathelp is on the way. In such case, the rules engine and database generatethe message and the communications system sends the message to thebystander.

One or more additional messages are sent to the trained responders.After the trained responders respond to the alert indicating they arecoming to assist, the en route trained responders receive a messagecontaining the location of the nearest operational emergency equipment,such as AEDs. In such case, the rules engine and database generate amessage indicating the location of nearest functioning emergencyequipment and the communications system sends the message indicating thelocation of nearest operational emergency equipment to trainedresponders who are en route.

In embodiments of the invention, the bystander records the time ofarrival of the first trained responder via the APP, which then uses theWeb service to record such data in the database. The bystander alsorecords the time that emergency equipment and supplies are provided viathe APP, which again uses the Web service to record such data in thedatabase. Further, the bystander also records such other events as EMSarrival via the APP, which again uses the Web service to record suchdata in the database.

Embodiments of the invention provide emergency response data tracking,which documents the elapsed time from collapse to arrival of a firstresponder.

Embodiments of the invention allow the bystander to cancel the alert (asdiscussed above).

Embodiments of the invention allow a trained responder to communicate tobystander that they are on the way to provide assistance. As well,responders can communicate with each other, for example, where animpromptu, tiered emergency response is established to manage theresponse effort.

Database

All communications are logged in the database, and there is a report foreach incident. Aggregate reports can be generated across multipleincidents. Information captured in the database includes, for example:

-   1. Date, time, and GPS location of the alert;-   2. Who initiated the alert, by cell phone and GPS location;-   3. Who is notified of the alert, by cell phone number;-   4. Date and time of the notification;-   5. Who responds to the notification, by cell phone number and GPS    location;-   6. Date and time that emergency equipment location information is    sent to each responder via the communication system;-   7. Date and time of notification of responding trained responder and    geo-location of the trained responder at the time the confirming    notification is sent;-   8. Date and time of arrival of the first trained responder;-   9. Date and time that the emergency equipment is placed in use, e.g.    when an AED is attached;-   10. Date and time of EMS arrival;-   11. Date and time of alert and type of emergency;-   12. Who initiated alert by cell phone;-   13. Date and time that each IC was notified and confirmed    notification;-   14. Date and time that each TL notified and confirmed notification;-   15. Date and time that each WF notified;-   16. Date and time each IC, TL, and/or WF responded that they    received initial notification;-   17. Date and time that each WF confirmed notification received,    successful evacuation, and successfully reached assembly area is    confirmed;-   18. Date and time and GPS of all “failure to evacuate” or “distress”    messages;-   19. Date and time and content of each ongoing communication by text    between IC, TL, and/or WF and content of text and/or email    communication; and-   20. Date and time of EMS, fire, and/or police arrival by IC.    Sequence of Operations

The foregoing is illustrated in FIG. 5, which is a flow diagram showingthe sequence of operations during an emergency event according to theinvention. In FIG. 5:

-   Step 1. Bystander of emergency, such as a medical emergency (ME),    initiates emergency response notification system via mobile    application (“APP”):    -   1A: Bystander to APP-bystander of ME emergency initiates        emergency response notification system via APP by accessing and        using App on phone, tablet, etc.; bystander communicates        (type/vocal input) to APP the specific location within the        facility, e.g. 3rd floor bathroom); and    -   1B: APP to communication system;    -   1C: Communication system to Web service; and    -   1D: Web service to rules engine/database—Data inputted by        bystander, via cellular service, WIFI, etc., transmitted via Web        service to rules engine/database.-   Step 2. Bystander to 911—bystander of ME calls 911 directly from    APP:    -   2A: Bystander to APP;    -   2B: APP to communication system; and    -   2C: Communication system to 911;-   Step 3. App to bystander—bystander of ME receives optional    instruction to initiate first aid or resuscitation or other    assistance as specified on the APP.-   Step 4. Web service to rules engine/database—Web service runs    rule-driven query of rules engine/database. This query includes:-   a. Comparing location of event to nearest facility having trained    responders;-   b. Locating nearest trained responders in facility;-   c. Prioritizing notification of the trained responders by rules that    determine the level and type of training, competence, proximity;-   d. Locating nearest emergency equipment, e.g. AEDs/medical    equipment; and-   e. Prioritizing by rules that evaluate proximity to the event, and    emergency equipment functionality.-   Step 5. Message containing specific information sent to select    trained responders:

5A: Rules engine/database to communications system—Rules engine/databasegenerates message; and

-   -   5B Communications system to trained responders—Communications        system communicates the following information to selected        trained responders: The specific location of event within the        facility with instructions to respond prioritized by trained        responder training, competency and proximity rules.

-   Step 6. Message sent to bystander informing them how many trained    responders have been notified):    -   6A: Rules engine/database to communications system—Rules        engine/database generates message; and    -   6B: Communications system to bystander—Communications system        sends message to bystander.    -   If no responders are available, a message is sent to bystander        informing the bystander of the location of the nearest emergency        equipment prioritized by functionality rules:    -   6C: Rules engine/database to communications system—Rules        engine/database generates message; and    -   6D: Communications system to bystander—Communications system        sends message to bystander.

-   Step 7. Trained responder responds—Trained responders respond to the    alert text with a confirmation message that communicates to database    via the Web service indicating that they are responding. Message    generates geo-location of the trained responder:    -   7A: Trained responder to communication system;    -   7B: Communication system to Web service; and    -   7C: Web service to rules engine/database.

-   Step 8. Messages sent to bystander—As each trained responder    responds to the alert, indicating that the trained responder is    coming or not coming to assist, the bystander receives messages:    -   8A: Rules engine/database to communications system—Rules        engine/database generates message; and    -   8B: Communications system to bystander—Communications system        sends message to bystander.

-   Step 9. Messages sent to trained responders—After a trained    responder responds to the alert indicating they are on the way the    en route trained responders receive a message containing location of    nearest operational emergency equipment:    -   9A: Rules engine/database to communications system—Rules        engine/database generates message indicating location of nearest        functioning emergency equipment; and    -   9B: Communications system to trained responders—Communications        system sends a message indicating the location of nearest        operational emergency equipment trained responders who are en        route.

-   Step 10. Bystander to APP—bystander records time of arrival of first    trained responder via the APP which uses the Web service to record    data in database:    -   10A: Bystander to APP;    -   10B: APP to Web service; and    -   10C: Web service to database.

-   Step 11. Bystander to APP—bystander records time that emergency    equipment and supplies re provided via the APP which uses Web    service to record data in the database:    -   11A: Bystander to APP;    -   11 B: APP to Web service; and    -   11C: Web service to database.

-   Step 12. Bystander to APP—bystander records EMS arrival via APP    which uses the Web service to record data in the database:    -   12A: Bystander to APP;    -   12B: APP to Web service; and    -   12C: Web service to database.        Content

In embodiments of the invention, content that is communicated amongstthe participants can include, for example, specific written instructionson actions to perform; graphic representations, i.e. of actions toperform, video, voice, and graphics; use of voice commands/technology,such as SIM to provide instructions and/or content; and multi-lingualcapabilities. For example, this invention can be used with any languageincluding, for example, Chinese, Japanese, etc. with which the databaseis compatible.

In embodiments of the invention, participants receive content, basedupon their role, that includes:

ICs: Based on company-established level of responsibility, company-basedemergency response policies and procedures, and other instructivecompany established documents and protocols:

-   -   Initial procedures, e.g. turn off elevators and escalators, lock        certain doors, contact specific authorities inside and outside        of company;    -   Option to initiate variable protocols based by type of        emergency, including primary and secondary emergencies, medical        emergencies, non-medical, emergencies, etc.; and    -   Ongoing communications.

TLs or other designees, such as security: Based on company [establishedlevel of responsibility, company-based emergency response policies andprocedures of company, and other instructive company establisheddocuments and protocols:

-   -   Initial procedures, e.g. get radio, vest, megaphone, and/or        flag, and go to pre-assigned location to assist evacuation; and    -   Ongoing communications.

WF: Based on emergency response policies and procedures of company andlevel of complexity (described below):

-   -   Simple notification text instruction to evacuate and location of        assembly area;    -   Text indicating location of nearest exit based on their        pre-configured location and assembly area;    -   Graphic of evacuation route for their pre-configured location        and assembly area;    -   GPS or other technology driven instructions to nearest exit and        to assembly point based on their dynamic location; and    -   Bluetooth or wireless or other frequency transmitter driven        instructions to nearest exit and to assembly point.        Drill Functions

As discussed above, drill functions can be performed to prepareparticipants for an emergency. Drill codes allow selection of an ad hocgroup of participants, independent of organization or geographicboundaries. At the start of a drill, all participants are given a sharedcode, which each person enters at about the same time into his handhelddevice. This code therefore defines the group of participants. Drillcodes automatically expire after a fixed time, e.g. the duration of adrill, so that they can re-used in the future. When a drill incident isinitiated, only the participants in the pool with valid, unexpired drillcodes are alerted. Using drill codes during responder classes allows theemergency response system to be used across organizational barriers orgeography.

A drill simulates an emergency and helps assess the adequacy ofemergency response in the facility and/or organization and to allowrepetitive practice, which enhances the quality and reduces the time tocarry out the response with increased familiarity. The instructor forthe drill enters drill code as initiator of the drill. Students,responders, and personnel attending the class enter drill code asresponders. Only those individuals who have entered the drill codereceive the communications during the drill. All messaging begins with anotification that is received via the APP, such as MEDICALDRILL/EMERGENCY DRILL.

Spontaneous drills, i.e. drills that do not have drill codes, may alsobe held to test the system and response abilities of a facility and toempower the workforce by practicing for an emergency. In such cases, allresponders receive all communications and all messaging begins with anotification that is received via the APP, such as MEDICALDRILL/EMERGENCY DRILL. The instructor or other authorized person cancancel the alert at any time via the APP.

Sudden Cardiac Arrest (“SCA”) Emergency Response Notification System

FIG. 6 is a flow diagram showing the sequence of operations during anSCA emergency event according to the invention. The system for suchapplication is architecturally similar to the discussed above for ageneric emergency event, for example as discussed in connection withFIGS. 1 and 2. Those skilled in the art will appreciate that somevariations, all within their skill, may be made as appropriate toimplement this embodiment of the invention.

Database

In addition to that data stored in connection with a generic emergencyresponse system, as described above, data stored in database for thisembodiment of the invention also includes the location of AEDs byorganization, facility, address, and location in facility, such asfloor, and a specific description of location, e.g. 9th floor elevatorSouth; GPS coordinates; date of last successful maintenance; and date ofpad and battery expiration.

All communications are logged in the database and there is a report foreach incident. Aggregate reports are generated across multiple incidentsand include, for example:

-   1. Date, time, and GPS location of the alert;-   2. Who initiated the alert, by cell phone and GPS location;-   3. Who is notified of the alert, by cell phone number;-   4. Date and time of notification;-   5. Who responds to the alert, by cell phone number and GPS location;-   6. Date and time that information regarding AED locations is sent to    each responder via the communication system;-   7. Date and time of notification of responding, using GPS if    responder had APP;-   8. Date and time of arrival of first trained responder;-   9. Date and time that an AED is attached; and-   10. Date and time of EMS arrival.    Sequence of Activities/Communications in an SCA Emergency

In FIG. 6:

-   Step 1. bystander of SCA emergency initiates emergency response    notification system via mobile application (“APP”):    -   1A: bystander to APP—bystander of SCA emergency initiates        emergency response notification system via APP by accessing and        using the App on a phone, tablet, etc.; the bystander        communicates to APP, for example by typing or voice input, the        specific location within the facility, e.g. 3rd floor bathroom;    -   1B: APP to communication system;    -   1C: Communication system to Web service; and    -   1D: Web service to rules engine/database—Data input by the        bystander, e.g. via a cellular service, WIFI, etc. is        transmitted via the Web service to the rules engine/database.-   Step 2. bystander to 911—bystander of SCA calls 911 directly from    the APP:    -   2A: bystander to APP;    -   2B: APP to communication system; and    -   2C: Communication system to 911.-   Step 3. App to bystander—bystander of SCA receives optional    instructions to initiate resuscitation on the victim via APP.-   Step 4. Web service to rules engine/database—The Web service runs a    rule-driven query of rules engine/database. This query includes, for    example:-   a. Comparing location of event to nearest facility having trained    responders;-   b. Locating nearest trained responders in facility;-   c. Prioritizing notification of the trained responders by rules that    determine the level and type of training, competence, proximity;-   d. Locating nearest AEDs; and-   e. Prioritizing by rules that evaluate proximity to the event, and    AED functionality.-   Step 5. A message containing specific information is sent to    selected trained responders:    -   5A: Rules engine/database to communications system—Rules        engine/database generates message; and    -   5B Communications system to trained responders—Communications        system communicates the following information to selected        trained responders: The specific location of event within the        facility with instructions to respond prioritized by trained        responder training, competency and proximity rules.-   Step 6. Messages sent to the bystander informing the bystander how    many trained responders have been notified:    -   6A: Rules engine/database to communications system—Rules        engine/database generates message; and    -   6B: Communications system to bystander—Communications system        sends a message to the bystander.    -   If no responders are available, a message sent to the bystander        informing the bystander of the location of the nearest AEDs,        prioritized by functionality rules:    -   6C: Rules engine/database to communications system—Rules        engine/database generates message; and    -   6D: Communications system to bystander—Communications system        sends the message to bystander.-   Step 7. Trained responder responds—Trained responders respond to the    alert text with a confirmation message that communicates to the    database via the Web service indicating that they are responding.    The message generates a geo-location of the trained responder:    -   7A: Trained responder to communication system;    -   7B: Communication system to Web service; and    -   7C: Web service to rules engine/database.-   Step 8. Messages sent to the bystander—As each trained responder    responds to the alert, indicating whether the bystander is coming or    not coming to assist, the bystander receives messages:    -   8A: Rules engine/database to communications system—Rules        engine/database generates the message; and    -   8B: Communications system to bystander—Communications system        sends the message to bystander.-   Step 9. Messages sent to trained responders—After a trained    responder responds to the alert indicating that the trained    responder is coming to assist, the en route trained responders    receive a message containing the location of nearest functional    AEDs:    -   9A: Rules engine/database to communications system—Rules        engine/database generates message indicating location of nearest        functioning AEDs; and    -   9B: Communications system to trained responders—Communications        system sends a message indicating the location of the nearest        functioning AEDs to the trained responders who are en route.-   Step 10. bystander to APP—bystander records time of arrival of first    trained responder via the APP, which uses the Web service to record    data in the database:    -   10A: bystander to APP;    -   10B: APP to Web service; and    -   10C: Web service to database.-   Step 11. bystander to APP—bystander records time that the AED is    attached via the APP, which uses the Web service to record data in    the database:    -   11A: bystander to APP;    -   11 B: APP to Web service; and    -   11C: Web service to database.-   250 Step 12. bystander to APP—bystander records EMS arrival via the    APP, which uses the Web service to record data in the database:    -   12A: bystander to APP;    -   12B: APP to Web service; and    -   12C: Web service to database.        Sequence of Activities/Communications in a Non-Medical Emergency        (NME)

FIG. 7 is a flow diagram showing a non-medical emergency response modelaccording to the invention, in which the relationship between thegeneral workforce, floor wardens and/or emergency response team,security staff, and incident coordinator is shown. This model isdiscussed in detail below.

FIGS. 8A-8C are a flow diagrams showing the sequence of operationsduring a non-medical emergency event according to the invention.

In FIGS. 8A-8C:

-   Step 1. Bystander of NME initiates emergency response notification    system via mobile application (APP):    -   1A: Bystander to APP—bystander of NME emergency initiates        emergency response notification system via APP by accessing and        using APP on phone, tablet, etc.; Bystander communicates        (type/vocal input) to APP the specific location within the        facility, e.g. 3rd floor bathroom;    -   1 B: APP to communication system;    -   1C: Communication system to Web-service;    -   1 D: Web-service to rules engine/database—Data inputted by        bystander via cellular service, WIFI, and/or other is        transmitted via the Web-service to the rules engine/database:    -   a. Secondary screen allows selection between medical and        non-medical emergencies; or    -   b. Secondary screen uses drop down screen to select type of        medical or non-medical emergency; and/or    -   c. Permits text description of emergency.-   Step 2. Bystander to 911—Bystander of NME calls 911 directly from    APP:    -   2A: Bystander to APP;    -   2B: APP to communication system; and    -   2C: Communication system to 911.-   Step 3. App to Bystander—Bystander of NME receives optional    instruction to assist in emergency based on type of emergency and    competence level, i.e. nearest fire extinguisher with instructions    on how to use it if there is a small fire.-   Step 4. Web-service to Rules Engine/Database—Web-service runs a    rule-driven query of the rules engine/database. This query includes:-   Comparing location of event;-   Identifying IC, TL, and/or WF for facility;-   Selecting communications and content based on defined roles, i.e.    IC, TL, WF;-   Identifying nearest facility with trained responders;-   Prioritizing notification of personnel by roles;-   Locating nearest required equipment based on designated roles, type    of emergency, and availability of equipment by designated geographic    area; locating nearest AEDs/medical equipment;-   Prioritizing by rules that evaluate proximity to event and    AED/medical; and-   Prioritizing by rules that evaluate type of emergency, proximity to    event, and equipment functionality.-   Step 5. Message containing specific information sent to IC:    -   5A: Rules Engine/Database to Communications System—Rules        Engine/database to communications system generates message; and    -   5B: Communications System to IC—Communications system to IC        communicates the following information: notification of        emergency, location, and type of emergency with instructions for        completing initial pre-configured series of actions and to        confirm receipt of notification.-   Step 6. Message containing specific information sent to TL:    -   6A: Rules Engine/Database to Communications System—Rules        engine/database to communications system generates message; and    -   6B: Communications System to TL—Communications system to TL        communicates the following information: notification of        emergency, location, and type of emergency with instructions for        completing initial pre-configured series of actions and to        confirm receipt of notification, including to retrieve        equipment, supplies, assume proper location, assist with        evacuation, and confirm receipt of notification. In addition,        report initial and ongoing problems to IC. Variable content for        initial instructions includes ongoing communications, e.g. Doug        is unable to evacuate, because he is trapped under bookshelf        that fell; Mary needs a disability stair chair to exit; there is        a secondary fire in the hallway near the 3rd floor bathroom;        etc.-   Step 7. Message containing specific information sent to WF:    -   7A: Rules Engine/Database to Communications System—Rules        engine/database to communications system generates message; and    -   7B: Communications System to WF—Communications system to WF        communicates the need to initiate evacuation procedures        including location and/or directions to nearest evacuation exit        from their location, and assembly point address, and to confirm        receipt of notification. This can include variable quantity and        quality of content; and use of variable technologies to assist        with locating exits, such as Bluetooth or wireless transmitter        technology to assist WF to reach evacuation exit rapidly. The        message includes instructions to respond to alert text with        notification that they have evacuated and reached assembly        point.-   Step 8. IC to APP to Communication System to Web-Service to Rules    Engine/Database, where IC responds to the alert text, with    communication to database via the Web-service indicating that they    are assuming command, and if IC does not respond, an alternate    pre-designated authority is notified:    -   8A: IC to APP—IC responds to the alert text, with communication        to database via web-service indicating that they are assuming        command;    -   8B: APP to Communication System;    -   8C: Communication System to Web-Service; and    -   8D: Web-Service to Rules Engine/Database—Data inputted by IC via        cellular service, WIFI, and/or other is transmitted via the        Web-service to the rules engine/database.-   Step 9. TL to APP to Communication System to Web-Service to Rules    Engine/Database. TLs respond to the alert text with communication to    database via the Web-service, indicating that they are responding    and assuming their responsibilities. If no response, the IC assesses    the need for additional personnel notification:    -   9A: TL to APP—TLs respond to the alert text with communication        to database via the Web-service, indicating that they are        responding and assuming their responsibilities;    -   9B: APP to Communication System;    -   9C: Communication System to Web-Service; and    -   9D: Web-Service to Rules Engine/Database—Data inputted by IC via        cellular service, WIFI, and/or other) is transmitted via the        Web-service to the rules engine/database.-   Step 10. WF to APP to Communication System to Web-Service to Rules    Engine/Database. WF responds to the alert text with communication to    the database via Web-service, indicating that they have received    notification:    -   10A(1): WF to APP—WF responds to the alert text with        communication to database via the Web-service, indicating that        they have received notification;    -   10B(1): APP to Communication System;    -   10C(1): Communication System to Web-Service; and    -   10D(1): Web-Service to Rules Engine/Database—Data inputted by IC        via cellular service, WIFI, and/or other is transmitted via the        Web-service to the rules engine/database. WF clicks notification        on evacuation screen that they have successfully evacuated.    -   10A(2): WF to APP—WF clicks notification on evacuation screen        that they have successfully evacuated;    -   10B(2): APP to Communication System;    -   10C(2): Communication System to Web-Service; and    -   10D(2): Web-Service to Rules Engine/Database—Data inputted by IC        via cellular service, WIFI, and/or other is transmitted via the        Web-service to the rules engine/database. WF clicks notification        on assembly screen that they have successfully arrived at        assembly point.    -   10A(3): WF to APP—WF clicks notification on assembly screen that        they have successfully arrived at assembly point;    -   10B(3): APP to Communication System;    -   10C(3): Communication System to Web-Service; and    -   10D(3): Web-Service to Rules Engine/Database—Data inputted by IC        via cellular service, WIFI, and/or other is transmitted via the        Web-service to the rules engine/database.-   Step 11. RE to IC: Database/rules engine generates communication to    IC providing continuously updated and/or compiled report of    personnel who have successfully evacuated and reached assembly    point, including a continuously updated report of all personnel who    have confirmed receipt of notified of emergency and their GPS    location, a continuously updated report of all personnel who have    provided notification of evacuation and their GPS location, and a    continuously updated report of all personnel who have provided    notification of arriving at the assembly area and their GPS    location.-   Step 12. IC to APP to Communication System to Web Service to Rules    Engine/Database: IC indicating time of arrival of each    EMS/Fire/Police arrival.-   Step 13. IC to APP to Communication System to Web Service to Rules    Engine/Database: IC requests APP geo-locate location of all    personnel.-   Step 14. Database/Rules engine to Communication System: Dynamically    generated map of cellphones locating personnel who have not    evacuated as per GPS coordinates within the facility and require    assistance.-   Step 15. Ongoing communication between ICs, TLs, and WF:

Ongoing communication between ICs, TLs, and WF including requests forassistance; identification of injuries, e.g. Joe broke leg from fallingdebris, Doug had a heart attack, Sam sustains major bleed from fallingglass; identification of secondary emergencies, e.g. fire followingearthquake, do something on the chart that indicates all the way acrossthe IC, WF, TL, and people ongoing communications.

Workforce Evacuation Notification

FIGS. 9A-9D area series of screenshots showing a workforce evacuationnotification sequence according to the invention, which an individualuses the APP to send a notification that they have received theevacuation notification (FIG. 9A), that they have exited the building(FIG. 9B), and that they have arrived at their pre-designated assemblypoint (FIG. 9C); or that they are in distress (FIG. 9D).

Embodiments of the invention identify evacuation exits with atransmitted signal to direct workforce members to a nearest evacuationexit. The signal can comprise any one or more of a Wi-Fi-based IPaddresses, Bluetooth, radio, satellite, pre-placed transmissionequipment proximate to said exits, Wi-Fi-based signals transmitted fromexit doors at said exits. Wi-Fi signals from a nearest router.

Embodiments of the invention locate non-evacuating personnel with atransmitted signal. The signal can comprise any one or more ofWi-Fi-based IP addresses, Bluetooth, radio, satellite, pre-placedtransmission equipment proximate to said exits, Wi-Fi-based signalstransmitted from exit doors at said exits, Wi-Fi signals from a nearestrouter. In embodiments of the invention, the signal includesinstructions in any of text and graphic format to said non-evacuatingpersonnel directing them to a nearest exit. Notifications can includeany one or more of text, graphics, voice, and visual dynamic directions,such as GPS directions (WAZE).

In embodiments of the invention, location information can be determinedfrom, for example, the elevation component of GPS, where the height ofeach floor is pre-calculated to locate the individual by floor. Locationinformation can also be determined from the APP using the proximity ofthe phone signal to the IP of the routers in the facility; using theproximity of the phone signal to the wireless signal of a transmitterlocated in the evacuation door; using the proximity of the phone signalto the Bluetooth signal of a transmitter located on the evacuation door;or with any device that can transmit and receive signals. Embodiments ofthe invention use any of the foregoing techniques to create a dynamicmap of the location of workforce personnel, trained responders,emergency equipment, exit doors, etc.

Role-Based Task Generation

FIG. 10 is a flow diagram showing an example of how the role-baseddetails are lifted out of the emergency response protocol andtransmitted to the appropriate role-based individual in an emergency,where an electronic site survey generates organization specificemergency response protocols that detail role-based tasks according tothe invention.

In FIG. 10, the top screen is a sample frame of an electronic sitesurvey that is completed by an organization. Authorized personnelcomplete text screens in answer to questions that reflect the customizedinformation that is included in their emergency response policies,procedures, plans, and protocols. For example, in #51, the organizationstates that the phone number that must be dialed to reach an outsideline and call 911 is actually 9-911. This phone number is incorporatedinto their Emergency Response Protocol (bottom screen on the right inFIG. 10). This field is transmitted to the mobile application toindividuals who are attempting to initiate a call to 911 from a companylandline.

In example #53, the initial tasks of the Incident Commander aredetermined and typed into the electronic site survey (top of FIG. 10) bythe incident commander or his designee who is authorized to develop theorganization's policies and procedures. Once it is confirmed that theseare the organizational IC's initial responsibilities in an emergency,they are incorporated into the organization's emergency response plan(top frame in lower half of page on the right In FIG. 10). At the timeof an emergency, these tasks are transmitted to the IC on his mobileapplication, upon confirmation of receipt of notification of anemergency from a bystander and/or witness for an emergency that requiresinitiation of a command structure.

Alert Cancellation

FIG. 11 is a flow diagram showing the cancellation of an alert accordingto the invention. In FIG. 11 if an alert is to be cancelled 60, the APPprovides a message the bystander 62 advising the bystander that thealert can be cancelled. A button 64 can then be selected by thebystander to cancel the alert.

If the bystander did not intend to cancel the alert, the cancellationcan be rescinded by pressing a button, e.g. press green to re-alert theemergency responders. The alert is then reinstituted. For example,during an alert the system alerts the bystander to take an action (2),such as applying CPR if trained or willing to do so. The systems recordsthat time at which the first responder is on the scene (2). The APPprovides a button for the bystander to press indicating the arrival ofthe first responder. The system also records such activities as theattaching of an AED to the victim (2). Again, a button can be pressed bythe bystander to indicate this action has taken place. The system alsorecords when an EMS arrives (2). Again, a button can be pressed by thebystander to indicate this event has taken place. Thereafter, the alertis completed (2).

The APP

The APP is a mobile application that alerts all trained first respondersto the scene of an emergency, such as a sudden cardiac arrest (SCA) ormedical emergency. Users may be certified trained responders orlaypersons. For example, consider the following participants in a suddencardiac arrest (SCA) or medical emergency:

-   1. The victim of the medical emergency;-   2. Bystanders to the event, whether laypersons or trained    responders; and-   3. Certified first responders who are not at the event.    Embodiments of the Invention Include:    Real Life Event

As part of an organization's emergency response plan, the generalworkforce downloads and initially registers the mobile application.Bystanders to the event activate the APP and verify the event location.If the event occurs at the location for which the bystander originallyregistered, then the bystander types in the specific location of theevent into provided field. If the bystander is at a different location,then a drop-down menu is provided for an alternative facility where thebystander is now located. (In embodiments of the invention, GPS is usedas first determinant of location and, if it is not available, then thesystem falls back on a pre-configured location, and the user must changelocation by a drop-down menu.

The APP communicates the location of the emergency to the database andrules engine system via a Web service. The rules engine uses analgorithm and searches the specified company and facility for aprioritized call-to-action list of certified first responders. Inembodiments of the invention, the order of priority of called respondersis the most recently trained responders, certified responders, certifiedtrainees, and trainees requiring re-certification. The Web servicecompiles a list of the certified first responders in order of mostrecent skills dates, i.e. certification dates, to least recent skillsdates.

The system sends both an email and a text message to these certifiedfirst responders at the facility. To send the email or a text message,the APP sends a request to the Web service. The Web service sends outthe emails through, for example, SMTP. The SMS gateway captures theoriginal call-to-action ID and establishes communication between thebystander and the facility alerted responders. Each responder receivesmultiple alerts via SMS and emails to ensure that this notification isunique from typical SMS/email reception. Upon receiving an alert, theresponder replies via SMS/email if they are on the way. The bystanderreceives a notification on their smartphone, tablet, etc. of the numberof responders that have been alerted and the number of responders thatare on the way. The APP performs tracking of the event's vital clinicalperformance milestones, such as time to first responder arrival; time toAED Pad attachment; and time to EMS arrival.

Facility Wide Drill

This function allows trained responders to practice their facility'semergency response plan and has the same functionality as a real-lifeevent, except that the actual content of the email and text alertsindicates “THIS IS A DRILL.” Text messages and email are only sent onetime.

Drill Code Option

This embodiment of the invention provides the same functionality as thefacility wide drill, except this embodiment is class specific and isused during a training class. This means that the APP is activated, andmessages are sent to a specific subset of people. Rather than thealgorithm pulling certification dates and sorting responders to receivealerts, the participants all enter a specific drill code. Those enteringthe drill code receive the email and text. The email and text are sentas many times as the APP button is pushed. This drill code can be usedregardless of company or facility. Thus, trainees from different sitescan train together and get alerts.

Operation

Critical to the viability of the APP is the availability of the databaseand rules engine system that stores the physical facilities and thecertified responders who are located at each facility. Responders mustcomplete regular training and drills which are tracked in the databaseand rules engine system.

Responders receive certifications in areas such as CPR, First Aid, andAED response. Response planning is structured to ensure adequateresponse time from one or more trained responders within the physicallocation.

As part of a program rollout at a facility, employees of an organizationare encouraged to download and install the mobile APP on their phones.Registration and downloading the App requires that the user enter, forexample, a code specific to a certain company. Based on this code, amenu of locations is provided, allowing the user to select theappropriate facility. The list of locations is retrieved from a centralWeb service over the public Internet. The Web service uses the databaseand rules engine system to retrieve the list of facilities using thecompany code.

Once the location is selected, the user also provides his name, emailaddress, and phone number to register the APP. The registrationinformation is passed to the database and rules engine system viaanother Web service. The information is also stored on the user's phoneor tablet. More information about the responders and other members ofthe emergency response team is stored in the database, but it is notnecessarily related to registration for the APP. For example, suchinformation is retrieved based on the individual's role as defined inthe database. In fact, in embodiments of the invention responders do notneed to have the APP to be contacted. They are automatically contactedonce an alert is sent to the database, based on the rules enginedetermining who is required for the emergency, which is pre-configuredby role in the database. Responders are identified in the database, forexample, by their email address, cell phone number, name, company, andfacility. All of the above information is stored based on identifyingthe individual in this way, i.e. their training status, their role, and,therefore, the information that they are to receive.

Although responders do not have to be registered to be notified in caseof an emergency, they must be registered to send an alert themselves.

In embodiments of the invention, users of the APP are either any ofuntrained general workforce members who serve as the witness orbystander of the emergency and initiated the notification process and/orinitiate the emergency response plan, and trained responders who mayalso witness an emergency.

Subsequent launching of the APP bypasses the registration process andthe user is immediately prompted, “Do you have an Emergency?”, to whichthe user can answer “Yes,” “No,” or “Drill.” If the user answers “Yes,”a screen with a large button is presented, that initiates the medicalresponse protocol. Prior to pressing the button, the user can verifytheir location or enter specific location information, e.g. via touch ordictation. Answering “No” allows users to obtain non-emergencyinformation or change their registration information. Answering “Drill”is discussed below.

When the button is pressed, the notification process begins. The APPinvokes another network Web service, including the location, phonenumber, and name of the initiator. The Web service logs an incident inthe database and rules engine system and then retrieves a list ofpotential responders using the certification data for the facility. Theresponder list is sorted so that most recently certified responders areat the top of the list and added to a messaging system queue. Theservice then returns the number of notifications that are queued, andthe initiator is told how many messages were sent.

The messaging system sends medical alert text messages to responderphones and also sends email messages as a back-up. The responders do notneed an APP to receive these messages. The messaging system interactswith a third-party SMS gateway using its public API to transmit theactual messages. The gateway is configured with a pool of phone numbersand the messaging system transmits the text messages by rotating throughthe phone numbers pool. This allows transmission of hundreds ofemergency notifications within seconds, without drops from phone systemcarriers, seconds that are critical for a cardiac event. The textmessage notification includes a prompt to “reply Yes if you willrespond” and the SMS gateway is configured to invoke a Web service whenit receives such a response. This Web service tracks the responses andsends additional text messages back to the initiator, letting theinitiator know that a responder is en route.

After initiating the event notification, the mobile APP user is taken toprogressive screens where further progress is tracked. The user isprompted to call the 911 service, then asked to push buttonsprogressively, e.g. when the responder arrives, when a defibrillator(AED) is attached, and when EMS arrives. Each of these actions interactswith the Web services to record these events along with associatedtimestamps in the database and rules engine system. Over time, thisallows data about such events to be collected, which can be analyzed andsummarized to produce response rate studies. The user may also cancel anincident if the notification system was initiated in error. As with theinitial notification, a Web service is invoked which determines the listof responders and, in the same manner as before, cancellation messagesare sent to the responders.

It is important to practice emergency response events regularly usingdrills. After registration has been completed, the user also has theoption to select “Drill” when launching the mobile APP. As discussedabove, there are two types of drills, a facility-wide drill and aclassroom drill using a drill code. After pressing “Drill” the user isprompted to enter a drill code for a classroom drill or leave it blankfor a facility-wide drill. The facility wide drill is identical to theactual incident notification process described above, except that thenotifications clearly include “THIS IS A DRILL” in the text.

The classroom drill requires the instructor or drill coordinator toprovide a drill code to all of the participants. The mobile APP userscan then enter the drill code and join the drill either as an eventinitiator or responder. The APP transmits the phone numbers to a Webservice which tracks drill codes and participants in the database andrules engine system. Initiators are then taken to through the samescreens described above, with the button to begin the notifications.However, the drill code is included in the incident notification Webservice and, instead of retrieving all responders at a particularfacility, it retrieves only those responders associated with the drillcode. In this mode, only the drill code is used for selectingresponders.

The drill responders can be selected from across multiple facilities.Drill codes have a limited validity period, e.g. 30 minutes, dependingon the class timeframe. Responders are not notified if they joined thedrill during a period that has lapsed.

User Interface

FIG. 12-17 are screen shots showing various user screens provided by theAPP during an emergency.

Do you have an emergency? See FIG. 12.

This screen asks the user if they have an emergency and presents themwith two options, yes or no. By clicking on the “yes” button the userstarts the emergency response sequence. If the user chooses the “no”option they are taken to a menu that provides three choices to learnmore about the APP, the AED program, or CPR/AED training.

EU-Alert Information Menu

By clicking on the “no” option in the “do you have an emergency screen”the user taken to this screen which has three informative options whichare identical to the “thank you for registering screen.”

Emergency Alert Initiated. See FIG. 13.

Initiate the emergency response plan by yelling out Medical Emergency!!We need a responder!! To proceed to the next step, press the “nextbutton.”

Notify Your Trained Emergency Responders. See FIG. 14.

Ensure that correct site is highlighted in the drop-down menu. Provide aspecific location in the second data field and press the green button tosend out the alert to nearby responders.

Emergency Alert Confirmation. See FIG. 15.

Press the green button to automatically call 911 and alert the local EMSabout the event. If someone else is calling 911, or the local EMS havealready been notified, press the purple button. If the user wishes tocancel the alert, press the blue button in the top right corner of thescreen.

Start CPR. See FIG. 16.

If you are qualified to perform CPR, please begin to do so immediately.Once the responders arrive with the AED please press the green button inthe middle to move on to the next screen. The user also has the optionto cancel the alert for any reason by pressing the blue “cancel alert”button in the top right corner of the screen.

Attach AED. See FIG. 17.

When the responders arrive with the AED in hand, make sure to properlyattach the device to the victim as quickly as possible. Once this hasbeen completed press the green button in the middle of the screen tomove on to the next step. If the user needs to cancel the alert, pressthe blue button in the top right corner.

Confirm EMS

Once EMS arrives at the scene press the green button in the middle tocomplete the alert.

Augmented Reality

Embodiments of the invention provide augmented reality displays tosystem users, for example to show a route to equipment, to a buildingexit, etc. To augment a display feature, a map is created for thefacility, sensors are located on the map, and routes through thefacility are established.

Digital Representation Map of Facility (see FIG. 18). To create adigital representation map of a facility:

-   1. Creating or procuring an image, PDF, map, or other representation    of the facility.-   2. If an image or PDF, a software application traces the image into    discernible vectors that permits the extraction of required data.-   3. The software application extracts the dimensions of exterior    walls, interior walls, and fixed objects, for example in meters or    any other measurement scheme (1800).-   4. Using an origin, for example at (0,0), the software application    translates the extracted data to an coordinate system, such as an    (x,y) coordinate system (1810).-   5. The software application inputs appropriate coordinate system    data into a database (1820).-   6. Testing is performed to ensure that the coordinate system is    accurate (1830).

Install or Integrate with physical sensors, objects (see FIG. 19):

-   1. Install physical sensors of objects in or around the facility at    designated locations, consistent with the sensor specifications and    facility logistics (1900). For example, embodiments map the routes    programmatically using a physical reference point, such as a seat    number, QR code on exit signs, etc. Alternatively, integrate with    existing physical sensors and/or physical objects (1910). For    example, using Wi-Fi points, cell propagation antennas, Bluetooth,    cell towers, etc.-   2. The software application inputs sensor location that is    determined using a pre-developed facility-specific coordinate system    into the database (1920).-   3. The software application allows the naming and input of    associated sensor asset and/or marker data into the database (1930).

Establish horizontal and vertical planes (see FIG. 20):

The software application allows the user to enter a configuration modeand then scan the facility to establish horizontal and vertical planesattached to floors, walls, and fixed objects (2000).

Placement of digital markers (see FIG. 21):

-   1. The software application allows the user to enter configuration    mode and then place digital markers at various points, such as    reference points and/or those that require a change of direction, an    elevator, or that are an end-point in a route (2100).-   2. The software application allows the naming and input of digital    markers into the database (2110).

Defining routes (see FIG. 22):

-   1. The software application allows a user to create a route between    two or more selected physical sensors, objects, or digital markers    by tapping on them on a display, thus creating a route between the    two sensors, objects or digital markers (2200).-   2. In embodiments, the software application determines the distance    between two sensors and then inputs the sensors' coordinates and    distance into the database. (2210)

Indoor localization of Person or Object (see FIG. 23A):

-   1. In embodiments, the software application uses a combination of    three physical sensors (2300), digital markers (2310), or physical    object locations (2320) to triangulate the position of a person or    object to be routed from or to.-   2. The software application determines the distance to the sensors,    for example using the sensor's frequency and power information.-   3. In embodiments, the distance is then used by the software    application to triangulate the position of a person or object    (2330). If a physical sensor is used, e.g. BLE Beacons; otherwise,    if a digital marker is used, the indoor location is inherently    given.-   4. The coordinate of the triangulated position is translated by the    software application from the (x,y) coordinate system to the    augmented reality scene coordinate system (2340).-   5. If the user moves from an indoor location to an outdoor location,    the outdoor localizing is used (2380) (see FIG. 23B).

Outdoor localization of Person or Object (see FIG. 23B):

-   1. The software application uses, for example, GPS data gathered    from the phone's hardware (2350) or physical object location (2360)    to determine the position of the person or object-   2. The location is translated by the software application into the    augmented reality scene coordinate system (2370).

Routing (see FIG. 24):

-   1. After the user's location is obtained (2400) (see FIGS. 23A/23B),    the software application uses a Minimum Spanning Tree algorithm or    other method for determining the quickest route given coordinates to    obtain the optimal route (2410).-   2. The software application:-   a. Represents the route to the user by projecting the path into the    augmented reality scene view (2420).-   b. Represents the movement by projecting arrows onto the lines    (2430).-   c. Represents points of interest using icons (2440).-   d. Hides augmented scene objects behind vertical and horizontal    planes, for example, using a transparent mask that is overlayed on    top of detected planes (2450).-   e. Re-routes the user if an obstruction is detected in the path    (2460), the type of object is identified (2470):    -   i. Small objects: Re-route around the object (2480); and    -   ii. Large objects: Disable route (2490).        -   Notify all participants in the event to disable the blocked            route (2495); and        -   As part of the notification, machine learning is used by the            software application to determine the type of obstruction,            e.g. desk, fire, collapsed wall.            AR Workflow

Embodiments of the invention provide an augmented reality app in amobile or wearable device that uses multiple sensing methods to positiona user inside or outside a building. Based on the user's location, theapp superimposes a route into an augmented scene, thus routing the userfrom their location to a calculated point of interest. Based on newinformation from various sensing methods, the application responds bydirecting the user towards a different route if their primary routebecomes compromised. The new route information is immediatelytransmitted to other nearby users to be re-routed as necessary.

Sensing devices (mobile or wearable) are defined to be any handheld orwearable devices that are capable of displaying a 2D or 3D rasterizedmap or augmented scene, such as:

-   -   Mobile Cellphone    -   Smart Watch    -   Smart Glasses    -   Tablets    -   Laptops

The aforementioned devices are used based on available positioningsensors.

The augmented reality app uses at least one of the following sensingmethods to achieve indoor positioning:

-   1. Passive Sensing: Scan a QR code, bar code, or object of interest    with camera-   2. Lidar-   3. Active Sensing: RF Beacons, BLE Beacons, Cellular propagation    antennas, WI-FI access points, Emergency Lights, Bluetooth

Sensing is not limited to those techniques listed above. Additionally,as new methods are created embodiments of the invention can use suchmethods for user positioning.

Process

Using a sensing device, a user opens the app and the app beginscollecting data to attempt to triangulate the user's position, ifavailable:

-   -   GPS coordinates (longitude, latitude, altitude)    -   Active sensor information    -   Etc.        Exemplary Triangulation Formula

If active sensors are being used, a triangulation formula is applied tothe three nearest sensors:

Part I—Obtain a translation vector and angle

-   1. Use the three closest beacons by determining their distance:

$\begin{matrix}{D = {10\frac{T_{x} - R_{s}}{10n}}} & \left( {{Eq}.\mspace{14mu} 1} \right)\end{matrix}$

Where T_(x)=given TxPower of the sensor,

-   -   R_(s)=RSSI value of the sensor,    -   n=2, though can be calibrated between 2-4

-   2. Create a translation vector by using P₁ and moving P₁ to the    origin, therefor the translation vector is:    =−P ₁  (Eq. 2)

-   3. Apply the translation vector to P₁, P₂, P₃    P ₁ =P ₁+      (Eq. 3)    P ₂ =P ₂+      (Eq. 4)    P ₃ =P ₃+      (Eq. 5)

-   4. Create a translation angle by moving P₂y to 0, thus creating a    vector for P₂=    P₂ x, 0    :    -   a. Find the magnitude of P₂        ∥P ₂∥=√{square root over (P ₂ x ² +yx ²)}  (Eq. 6)    -   b. Obtain the angle

$\begin{matrix}{\theta = {\cos^{- 1}\frac{P_{2}\mspace{14mu} x}{P_{2}}}} & \left( {{Eq}.\mspace{14mu} 7} \right)\end{matrix}$

-   5. Apply the translation angle to P₂, P₃. Note P₁=    0.0    so it does not need a translation angle applied to it

if θ>0, then use:x=cos θ−sin θ  (Eq. 8)y=sin θ+cos θ  (Eq. 9)

else if θ<0x=cos θ+sin θ  (Eq. 10)y=−sin θ+cos θ  (Eq. 11)Part II—Calculate the Translated Triangulated Position

$\begin{matrix}{x = \frac{r_{1}^{2} - r_{2}^{2} + {P\; 2_{x}^{2}}}{2P\; 2_{x}}} & \left( {{Eq}.\mspace{14mu} 12} \right) \\{y = \frac{r_{1}^{2} - r_{3}^{2} + {P\; 3_{x}^{2}} + {P\; 3_{y}^{2}}}{{2P\; 3_{y}} - {\frac{P\; 3_{x}}{P\; 3_{y}}x}}} & \left( {{Eq}.\mspace{14mu} 13} \right)\end{matrix}$

where r_(n)=radius (distance) of n beacon,

P_(n)=translated beacon X, Y coordinate

let

=

x, y

Part III—Translate

to the Original Rotation and Translation

-   1. Rotate the position of    by —θ using the formula defined in Part I.5 above-   2. Translate    by    =    −

Note: the sensors location is pre-determined and mapped into acoordinate system that, in an embodiment, is defined in meters by thefacilities dimensions.

Otherwise, if passive sensors are being used, the user scans an objectwith a camera or other mechanism:

=position of passive mechanism

is an X,Y coordinate, expressed in meter and based in the facility thatis used to determine the user's location. The coordinates are checkedagainst the user's device accelerometer and gyroscope to ensure accuratereadings.

Given an accurate location reading, a minimum-spanning-tree algorithm,for example, is used to calculate a route from the users' physicallocation, augmented into the coordinate system, to a point of interest,e.g. another user's phone, physical object (equipment), point ofinterest such as GPS, non-GPS.

The route is determined, for example, by using minimum values between atree of points. Points themselves are defined to be coordinates in theaugmented map, as determined by digital markers, GPS markers, orphysical sensors, e.g. BLE beacons.

Once a refined route has been determined, the route is augmented into:

-   1. A map of the facility, such as a 2D rasterized map or other    representation of the facility or outdoor location:    -   In an embodiment, to determine a 2D rasterized map, a set of        coordinates determining exterior and interior walls are        required. The information is then uploaded into the system. The        rasterized map is a representation of connecting the coordinates        together.    -   Outdoor location is defined by any available technique, such as        a GPS coordinate, obtained by the phone's mechanism/API, etc.-   2. The Augmented Reality scene:    -   The scene position of the line is calculated from the digital        markers defining the routes. In embodiments, the scene-position        of a line representing the route is calculated and translated        from the 2D coordinate system into a 3D scene coordinate system.    -   The line representation consists of moving arrows from the        direction of the users position to the point of interest. If        there are markers delineating exit points, corners,        obstructions, the line, and thus the arrows, move towards the        next closest marker.        -   Markers indicating, for example, point of interests are            displayed above the specified point of interest at a            predetermined height; such points of interest include but            are not limited to, e.g. another user's phone/distress,            equipment, assembly area, etc.    -   Objects behind stationary objects are omitted, for example, by        using occlusion behind detected vertical and horizontal planes.        The route does not appear through walls, doors, large objects,        such as tables, desks, couches, etc.    -   As a user follows the route and an obstruction is detected:        -   Small obstruction (chair): a minor correction is calculated            around the small object, if possible.        -   Large obstruction (fire, collapsed wall): the route is            disabled and a new route using an alternative path is            calculated. Nearby devices are updated of the newly disabled            route.            Setting Up

A configuration process from a client-side or system-side administratoris required to predetermine points of interest when digital markers areused.

Using a configuration applet, several things must be set up:

-   1. Set up the map by providing a digital copy of the blueprint.    Alternatively, translate physical dimensions of the user's location    into a desired coordinate system, e.g. measured in meters or any    other desired measurement system.-   2. Placement of physical sensors, e.g. BLE Beacons; scannable    indicators, e.g. barcodes, QR codes; or other methods of    indoor-positioning. The location must be tracked in the system.-   3. Placement of physical sensors or digital markers on equipment    storage housing or the equipment itself. Markers also include, for    example, dynamic sensors, e.g. handheld devices, wearables, such as    glasses and gloves, watches, computers, phones, etc. These sensors    track where the equipment is stored so the location can be used for    routing.-   4. Identifying stationary and permanent objects, such as flooring,    walls, tables, desks, etc. to determine vertical and horizontal    planes that are used for occlusion.-   5. Identifying points of interest at changes-of-directions in the    route, e.g. corners, bottom of stairwell, top of stairwell.    Embodiments use physical sensors for equipment or digital markers    for this purpose, although digital markers remain stationary and do    not move with the equipment.

FIGS. 25 and 26 show the placing of markers in connection with AR-basedrouting within or about a facility during a distress event (FIG. 25) andan evacuation (FIG. 26).

-   6. Configuration of an easily-recognizable naming convention for the    markers, sensors, and equipment. Namable objects are set in either a    list view of all placed markers, sensors, or via the map.-   7. Embodiments create routes by any method of associating one sensor    with another. In an embodiment, configuration of the route is set up    in the map by opening the map and selecting two markers, e.g.    digital, GPS, physical sensor. Once two markers are selected, the    app automatically creates a route between the two points and    represents the route with a line on the 2D rasterized map between    the two points.

At any time or once the configuration is complete, the configuration canbe saved or updated. When saved or updated, the newly added or changedinformation is uploaded to the secure server for all users to haveaccess to while using the application.

When a user opens the application, the server is queried based on theuser's chosen static location and physical location, as determined byGPS, as well as relative distance to predetermined facilities. Theconfiguration for those pre-determined facilities is used in theprocessing and displaying of routes.

Use Cases

Embodiments of the invention use the augmented reality functionality to:

-   1. Direct workforce personnel during evacuations, leading them to    pre-designated routes, including the designated floor exit, building    exit, and to their assembly point.-   2. Direct workforce personnel to designated shelters in their    facility.-   3. Direct responders to ill or injured personnel who have used the    app to indicate they are ill or in distress.-   4. Direct responders to the nearest functioning emergency equipment,    including AEDs, disaster bags, emergency medical kits, fire    extinguishers, etc.-   5. Direct all personnel away from hazards or danger zones resulting    from the ongoing emergency. For example, if the roof caves over the    rear evacuation exit, the herein disclosed AR automatically    re-routes them toward a safe exit.-   6. Direct all personnel away from dynamic danger zones, such as an    active shooter moving through a building.-   7. Administrators draw danger zones corresponding with unsafe areas    that the herein disclosed AR sees as unavailable routes and    optimizes the user's route to safety.-   8. The app allows all personnel to attach photos of suspicious    activity and persons. The admin can re-localize the danger zone as,    for example, the shooter's location changes, directing personnel    away from the dynamic danger zone.-   9. Use AR, nodes or sensors to track individual personnel's location    automatically indoors and outdoors, including exiting floor, exiting    building, and arriving at assembly points.-   10. Define one or more digital markers, each of the digital markers    comprising a set of coordinates that define an interim point of    interest. Use a relational algorithm and coordinate system to create    one or more routes with said digital markers. Where the digital    markers are a set of coordinates captured by an imaging device for    an augmented reality scene.-   11. Use machine learning to automatically detect obstructions and    capture, track, and report dangers and occluded routes.-   12. Provide redundant communication mechanisms, such as Bluetooth,    to communicate data between personnel when cellular, Internet    connectivity, and/or Wi-Fi is unavailable.    Computer Implementation

FIG. 18 is a block diagram of a computer system that may be used toimplement certain features of some of the embodiments of the invention.The computer system may be a server computer, a client computer, apersonal computer (PC), a user device, a tablet PC, a laptop computer, apersonal digital assistant (PDA), a cellular telephone, an iPhone, aniPad, a Blackberry, a processor, a telephone, a Web appliance, a networkrouter, switch or bridge, a console, a hand-held console, a (hand-held)gaming device, a music player, any portable, mobile, hand-held device,wearable device, or any machine capable of executing a set ofinstructions, sequential or otherwise, that specify actions to be takenby that machine.

The computing system 40 may include one or more central processing units(“processors”) 45, memory 41, input/output devices 44, e.g. keyboard andpointing devices, touch devices, display devices, storage devices 42,e.g. disk drives, and network adapters 43, e.g. network interfaces, thatare connected to an interconnect 46.

In FIG. 18, the interconnect is illustrated as an abstraction thatrepresents any one or more separate physical buses, point-to-pointconnections, or both connected by appropriate bridges, adapters, orcontrollers. The interconnect, therefore, may include, for example asystem bus, a peripheral component interconnect (PCI) bus or PCI-Expressbus, a Hyper Transport or industry standard architecture (ISA) bus, asmall computer system interface (SCSI) bus, a universal serial bus(USB), IIC (12C) bus, or an Institute of Electrical and ElectronicsEngineers (IEEE) standard 1394 bus, also referred to as Firewire.

The memory 41 and storage devices 42 are computer-readable storage mediathat may store instructions that implement at least portions of thevarious embodiments of the invention. In addition, the data structuresand message structures may be stored or transmitted via a datatransmission medium, e.g. a signal on a communications link. Variouscommunications links may be used, e.g. the Internet, a local areanetwork, a wide area network, or a point-to-point dial-up connection.Thus, computer readable media can include computer-readable storagemedia, e.g. non-transitory media, and computer-readable transmissionmedia.

The instructions stored in memory 41 can be implemented as softwareand/or firmware to program one or more processors to carry out theactions described above. In some embodiments of the invention, suchsoftware or firmware may be initially provided to the processing system40 by downloading it from a remote system through the computing system,e.g. via the network adapter 43.

The various embodiments of the invention introduced herein can beimplemented by, for example, programmable circuitry, e.g. one or moremicroprocessors, programmed with software and/or firmware, entirely inspecial-purpose hardwired, i.e. non-programmable, circuitry, or in acombination of such forms. Special-purpose hardwired circuitry may be inthe form of, for example, one or more ASICs, PLDs, FPGAs, etc.

Although the invention is described herein with reference to thepreferred embodiment, one skilled in the art will readily appreciatethat other applications may be substituted for those set forth hereinwithout departing from the spirit and scope of the present invention.

For example, embodiments of the invention apply rules to identify theoperational status of emergency equipment based on identifyingparameters, including most recent successful maintenance inspection,most recent confirmation of GPS location, expiration date of AED pads,expiration date of AED batteries, other expiration dates checked in caseof other equipment. See U.S. provisional patent application Ser. No.61/892,836, filed October 18, 23, which application is incorporatedherein in its entirety by this reference thereto.

Accordingly, the invention should only be limited by the Claims includedbelow.

The invention claimed is:
 1. A computer implemented method for routingcommunications signals in response to an emergency, comprising:providing a processor for receiving an input signal comprising aninitial notification transmitted by a bystander at a location andindicating that there is an emergency at said location; independently ofa central emergency medical services (EMS) notification system, saidprocessor extracting content from said signal comprising identificationof a specific location of said emergency and identification of saidemergency type; said processor using said extracted content to identifylaypersons at or near said location who are trained responders for saidemergency and who are most qualified to respond to said emergency basedupon the type of said emergency; said processor prioritizing saididentified most qualified trained responders based upon their trainingand qualification; and independently of said central notificationsystem, said processor transmitting a prioritized alert directly to atleast said identified most qualified trained responders comprising saidemergency type and said emergency location; said alert furthercomprising the display of a dynamic map identifying and displaying anyof the location of any of work force personnel, trained responders,emergency equipment, exit doors, and visual dynamic directions to anearest exit.
 2. The method of claim 1, further comprising generatingsaid dynamic map by: creating a map for said location to augment adisplay feature; locating sensors and/or physical objects on said map,and establishing routes to or away from said emergency location.
 3. Themethod of claim 2, further comprising creating said map for saidlocation by: procuring an image, file, map, or other representation ofall or part of a facility; when an image or file is procured tracingsaid image into discernible vectors for extraction of required data;extracting dimensions at said location of exterior walls, interiorwalls, and fixed objects; translating said extracted dimensions to arepresentative coordinate system; and inputting said representativecoordinate system data into a database.
 4. The method of claim 3,further comprising installing or Integrating said sensors or physicalobjects by: installing physical sensors or objects in or around saidlocation at designated positions; and/or integrating with existingphysical sensors and/or physical objects.
 5. The method of claim 3,further comprising; inputting one or more sensor locations into saiddatabase; establishing horizontal and vertical planes attached tofloors, walls, and fixed objects at said location; and placing digitalmarkers at points divergent points, including points that require achange of direction, an elevator, or that are an end-point in a route.6. The method of claim 5, further comprising: creating a route betweentwo selected physical sensors, objects, or digital markers; determiningdistance between the two selected physical sensors, objects, or digitalmarkers; and inputting said selected physical sensors, objects, ordigital markers s′ coordinates and distance into said database.
 7. Themethod of claim 6, further comprising localizing an indoor person orobject by: using a combination of physical sensors, digital markers, orphysical object locations to triangulate a position of a person orobject to be routed from or to; determining distance to the sensors;using distance to triangulate the position of a person or object;translating coordinates of the triangulated position to an augmentedreality scene coordinate system; and when the user moves from an indoorlocation to an outdoor location, switching to outdoor localizing.
 8. Themethod of claim 6, further comprising localizing any of an outdoorperson, object, or shape by: using location data gathered from a userdevice or physical object location to determine a location of the personor object; translating said location into an augmented reality scenecoordinate system; and when the user moves from an outdoor location toan indoor location, switching to indoor localizing.
 9. The method ofclaim 6, further comprising: using a minimum spanning tree algorithmafter the user's location is obtained to obtain an optimal route. 10.The method of claim 6, further comprising: representing the route to theuser by projecting a path into the augmented reality scene view;representing movement by projecting arrows onto the path; representingpoints of interest using icons; hiding augmented scene objects behind aphysical object; re-routing the user if an obstruction is detected inthe path by: identifying a type of object: for small objects, re-routingaround the object; and for large objects, disabling the route; notifyingall participants in the event of a disabled or blocked route; and usingmachine learning to determine the type of obstruction.
 11. The method ofclaim 1, further comprising: displaying said dynamic map using multiplesensing methods to position a user inside or outside of a facility;based on the user's location, superimposing a route into an augmentedscene to route the user from a current location to a calculated point ofinterest; and based on new information from one or more sensing methods,directing the user towards a different route if their primary routebecomes compromised; wherein the new route information is immediatelytransmitted to nearby users to be re-routed as necessary.
 12. A computerimplemented method for routing communications signals in response to anemergency, comprising: providing a processor for receiving an inputsignal comprising an initial notification transmitted by a bystander ata location and indicating that there is an emergency at said location;independently of a central emergency medical services (EMS) notificationsystem, said processor extracting content from said signal comprisingidentification of a specific location of said emergency andidentification of said emergency type; said processor using saidextracted content to identify laypersons at or near said location whoare trained responders for said emergency and who are most qualified torespond to said emergency based upon the type of said emergency; saidprocessor prioritizing said identified most qualified trained respondersbased upon their training and qualification; and independently of saidcentral notification system, said processor transmitting a prioritizedalert directly to at least said identified most qualified trainedresponders comprising said emergency type and said emergency location;said alert further comprising the display of a dynamic map identifyingand displaying any of the location of any of work force personnel,trained responders, emergency equipment, exit doors, and visual dynamicdirections to a nearest exit.
 13. The method of claim 12, furthercomprising: said processor identifying location and operational statusof emergency equipment based on parameters that include any of mostrecent successful maintenance inspection, expiration dates that arerelevant to critical equipment, components, supplies, and medicationthat require routine replacement due to their age and/or expirationdate; and said processor providing notifications to trained responderswho have indicated that they are responding, said notificationsidentifying nearest appropriate emergency equipment.
 14. The method ofclaim 12, further comprising: when GPS is available, said processorusing emergency event GPS location and dynamically comparing saidemergency event GPS location with a closest location as determined byGPS to identify appropriate trained responders; and when GPS is notavailable said processor using pre-configured location data.
 15. Themethod of claim 12, further comprising: said processor identifyinglocation and operational status of emergency equipment based onparameters that include most recent confirmation of GPS location. 16.The method of claim 12, further comprising: said processor receiving aconfirming response from trained responders who respond to said alert;and said processor providing a notification to said bystander indicatingreceipt of said notification from said trained responders who respond tosaid alert.
 17. The method of claim 12, further comprising: saidprocessor using multiple real-time notification channels to immediatelycommunicate between said bystander and said responder.
 18. The method ofclaim 12, further comprising: responsive to any of said initialnotification and said content, said processor providing said bystanderwith any of specific text-based, graphic, video, and voice instructionson actions to perform in response to said emergency.
 19. The method ofclaim 12, further comprising: said processor providing communication andactivity tracking of all communications and times at which actions aretaken.
 20. The method of claim 12, further comprising: said processorreceiving GPS location information for emergency equipment andconfirmation that said emergency equipment is operational.
 21. Themethod of claim 12, further comprising: said emergency comprising asudden cardiac arrest (SCA); and any of said processor usinggeo-location to identify said trained responders based on their locationwhen providing said confirming response; said processor providingidentification of AEDs based upon proximity and operational readiness;said processor providing notifications to said trained respondersidentifying a nearest AEDs prioritized by proximity; and said processorproviding communication and activity tracking of any of time a responderarrived, if and when an AEC is attached, and when an EMS arrived. 22.The method of claim 12, further comprising: said processor communicatinginstructions to individuals based on any of a type of emergency,organizational structure, pre-defined roles, equipment availability,training and experience, and an organization's emergency policies,procedures, protocols, and emergency response plans.
 23. The method ofclaim 12, further comprising: using AR, nodes or sensors to trackindividual personnel's location automatically indoors and outdoors,including exiting floor, exiting building, and arriving at assemblypoints.
 24. The method of claim 12, further comprising: defining one ormore digital markers, each of said digital markers comprising a set ofcoordinates that define an interim point of interest; and using arelational algorithm and coordinate system to create one or more routeswith said digital markers.
 25. The method of claim 24, furthercomprising: said digital markers comprising a set of coordinatescaptured by an imaging device for an augmented reality scene.
 26. Themethod of claim 12, further comprising: using machine learning toautomatically detect obstructions and capture, track, and report dangersand occluded routes.
 27. The method of claim 12, further comprising:providing redundant communication mechanisms to communicate data betweenpersonnel when cellular, Internet connectivity, and/or Wi-Fi isunavailable.
 28. A computer implemented method for routingcommunications signals in response to an emergency, comprising:providing a processor for receiving an input signal comprising aninitial notification transmitted by a bystander at a location andindicating that there is an emergency at said location; independently ofa central emergency medical services (EMS) notification system, saidprocessor extracting content from said signal comprising identificationof a specific location of said emergency and identification of saidemergency type; said processor exchanging information with individualworkforce members comprising any of notification to evacuate, where toevacuate to, confirmation of receipt of notification by workforce,evacuation from building confirmation, arrival at assembly pointconfirmation, notification of an emergency, and notification ofindividual workforce members who have issued a distress notification;independently of said central notification system, said processortransmitting an alert directly to said individual workforce memberscomprising the display of a dynamic map identifying and displaying anyof the location of any of work force personnel, trained responders,emergency equipment, exit doors, and visual dynamic directions to anearest exit.
 29. The method of claim 28, further comprising: saidprocessor providing an incident commander with aggregate, continuallyupdated reports of individuals who have successfully evacuated by pointsof evacuation; receipt of notification, including GPS location;evacuation from building, with new GPS location; and arrival at anassembly point by GPS location.
 30. The method of claim 28, furthercomprising: said processor providing an incident commander with distressnotifications from individual workforce members; and said processortriaging said distress notifications to security and emergency responseteam members.
 31. The method of claim 28, further comprising: saidprocessor providing an incident commander with aggregate, continuallyupdated reports of distress notification by degree of triage assigned.32. The method of claim 28, further comprising: said processor providingany of coded or time-limited coded drills for designated responders, orclasses and non-coded, facility wide drills to simulate actualemergencies.
 33. The method of claim 28, further comprising: saidprocessor incorporating time-based prompts to ensure necessaryindividuals are notified, and necessary actions are timely performed.34. The method of claim 28, further comprising: said processorascertaining whether a workforce member whose cell phone is turned on isstill in a facility if said workforce member has not confirmed receiptof a notification.
 35. The method of claim 28, further comprising: saidprocessor informing said bystander how many responders have beennotified.
 36. The method of claim 28, further comprising: said processoridentifying an individual having known disabilities, as specified duringsaid individual's registration; and said processor issuing apre-configured distress signal during an evacuation with specificinstructions for a trained responder, and location of nearestappropriate equipment based upon the disability, to assist saidindividual with equipment necessary to ensure they are able to evacuatesaid individual.
 37. The method of claim 28, further comprising: usingAR, nodes or sensors to track individual personnel's locationautomatically indoors and outdoors, including exiting floor, exitingbuilding, and arriving at assembly points.
 38. The method of claim 28,further comprising: defining one or more digital markers, each of saiddigital markers comprising a set of coordinates that define an interimpoint of interest; and using a relational algorithm and coordinatesystem to create one or more routes with said digital markers.
 39. Themethod of claim 38, further comprising: said digital markers comprisinga set of coordinates captured by an imaging device for an augmentedreality scene.
 40. The method of claim 28, further comprising: usingmachine learning to automatically detect obstructions and capture,track, and report dangers and occluded routes.
 41. The method of claim28, further comprising: providing redundant communication mechanisms tocommunicate data between personnel when cellular, Internet connectivity,and/or Wi-Fi is unavailable.
 42. The method of claim 12, furthercomprising: said dynamic map providing an augmented reality display forany of: directing workforce personnel during evacuations and leadingthem to pre-designated routes, including a designated floor exit,building exit, and/or assembly point; directing workforce personnel todesignated shelters proximate to their location; directing responders toill or injured personnel who have indicated that they are ill or indistress; directing responders to nearest functioning emergencyequipment; directing personnel away from hazards or danger zonesresulting from an ongoing emergency; directing personnel away fromdynamic danger zones; drawing danger zones corresponding with unsafeareas that are unavailable routes and optimizing the user's route tosafety; and attaching photos of suspicious activity and persons.
 43. Themethod of claim 28, further comprising: said dynamic map providing anaugmented reality display for any of: directing workforce personnelduring evacuations and leading them to pre-designated routes, includinga designated floor exit, building exit, and/or assembly point; directingworkforce personnel to designated shelters proximate to their location;directing responders to ill or injured personnel who have indicated thatthey are ill or in distress; directing responders to nearest functioningemergency equipment; directing personnel away from hazards or dangerzones resulting from an ongoing emergency; directing personnel away fromdynamic danger zones; drawing danger zones corresponding with unsafeareas that are unavailable routes and optimizing the user's route tosafety; and attaching photos of suspicious activity and persons.